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UPPER  BOUNDS,  SECONDARY  CONSTRAINTS,  AND  BLOCK  TRIANGULARITY 

IN  LINEAR  PROGRAMMING 


by 

George  B.  Dantzig 


\l 

V.lth  the  growing  awarenese  of  the  potentialitleo  oi'  the  linear 
i'l’ograjfjning  approacn  to  botn  dynamic  and  otatic  proLlemo  of  induotry, 
of  the  econoiiiy,  and  of  the  mixiiary,  the  main  obstacle  tov;ard  full 
application  io  tne  inability  of  c  .rrent  co;r.p.>tat  ional  metnodo  to 
cope  v.'itn  tne  nagntluce  of  the  technological  matrices  for  even  the 
simplest  situations.  Ho'.rever,  in  certain  cases,  3,ch  as  t.he  ncv; 
classical  HitcncocK-Koopma.ns  transportation  model,  it  nas  been 
possible  to  solve  the  linear  inequality  system  In  spite  of  size 
because  of  simple  properties  of  tne  system  j^c] .  This  suggests 
that  considerable  research  ue  u.ndertaze.n  to  exploit  cei'tain  special 
matrix  structures  in  order  tc  facilitate  ready  solution  of  larger 


I,nae«a,  rec-Tit  computational  experience  nas  maae  it  clear  that 
standard  techniques  suen  as  tne  simplex  aigorlthra, wnich  have  been 
.^wCd  to  solve  successfully  general  systems  involving  one  hundred 
equations  (in  any  reasonable  n;imber  of  non— negative  unknowns ),  are  too 
tedious  and  lengthy  to  be  practical  for  extensions  much  beyond  this 
figure.  Our  purpose  here  will  be  to  develop  short  cut  computational 
methods  for  solving  an  important  class  of  systems  v-zhose  matrices 
may  be  generally  described  as  -"block  triangular. 


Consider  a  system  of  equatiorjs 
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where  It  Is  desired  to  obtain  values 
y  a^.x,  is  to  be  minimised  (or-  what 

c-  OJ  ,J  - 

the  variable  ) . 


of  X,  such  that  tie  form 

j  - 

Is  the  same  Ihlfi.j  ‘:o  max  Ir: !se 


I  —  Variables  Upper  Bounds 

The  size  of  ma-.rix  assoviaied  with,  sue;,  a  linear  pr'osj’atrur.irjg 
problem  may  become  uncomfortably  large  when,  In  addition  'o  ( I— 1 ) , 
many  (or  all)  variables  of  the  initial  set  have  upper  bounds.  Thus, 
if  each  variable  satisfies  0  <  ,  it  is  customary  to  add  an 

additional  variable,  say  x',  and  a  new  equation 

(1-2)  Xj  +  xj  =  (x^  >  0,  xj  >  0) 

to  take  care  of  each  such  restriction.  To  illustrate,  by  way  of 
example,  a  linear  programming  problem  of  the  transportation  type 
involving  m  destinations  and  n  origins  has  a  matrix  involving  m+n 


rows  and  rn-n  variables  associated  will,  rn-n  possible  routes 
Jc^ninv,  origins  with  destinations .  Suppose  now  there  Is  a  canac  1  ty 

a  route  so  tJ.at  l.-;  c.Jdilion  to  the  original 
syswcrj  of  equations  and  linear  Inonualities  0  <  ^  ore  r.us’  impose 

m-n  additional  restraints 


lx, ,  >  0. 


>  0) 


i.».  is  clear  now  th.e  or’iginal  system,  has  been  expand^'-a  to  (mn  +  r  +  n) 
rov/s  a  ,d  urt-n  variables,  ’-ot  o.nly  has  tiic-  sysiem  Lecone  enor.iously 
er.iarged  out  it  is  not  clear'  xnat,  h.as  happened  to  that  wojiderful 
•.rianrularity  proper' y  for  t  ransportation  type  nodels  of  a  basis 
wiiich  pemlts  ease  of  hand  cor.putat J on .  Wo  shall  r-efer  to  tr.e  orir- 

MipiTTiiirf 

Inal  sysiem  plus  ti.cso  upper  bound  restrictions  as  the  enlarf-ed 
system..  Tl.o  ourpoue  of  tnis  section  is  to  show  that  the  upper 
sound  restrai.nts  whlcn  is  a  special  case  of  block  triangularity 
(see  Section  II)  may  bo  provided  for  oy  applying  the  simplex  al— 
gorith.m  [ibj  ,  ,  [Sa]  ,  to  the  original  system  with  due  care  that 

the  '"aiige  of  values  of  a  variable  appearing  in  a  basic  solution 
stays  witnln  its  upper  and  lower  bounds.  (See  footnotes  1,  2,  3, 
below  and  on  followi.ng  page).  In  this  paper  it  v/ill  be  assumed  that 


1.  A  problem  of  Optimum  Scheduling  of  Projects  oh  Punch  Card 
Equipment  considered  by  Clifford  Shaw  of  RAiND  was  characterized  by 
many  variables  with  fixed  upper  bounds.  (lliese  represented  the  maxi' 
mum  number  of  hours  that  could  be  assigned  to  a  project  in  a  work 
period.)  The  method  described  here  was  developed  to  provide  a 


__»4— 


the  reader  Is  familiar  .vlth  this  method.  By  way  of  reviev/,  a  basic 
8olu’,ion  to  (I— l)  is  defined  as  a  solution  in  which  n— m  variaoles 


X,  are  set  equal  to  zero  and  the  renialndei-  x^,  x. 
J  o’ 


X  . 

J 
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aatlcfy  (i4}  suci.  that  x^  >  0  and  the  submatrix  B  =  [P  ,  P.  3 

^  J  2  Or 


‘h  ^ 


'm 


formed  fror;  ti.e  columns  P  of  coefficients  of  these  varianlos  is 

o  1 

non— Girigular.  in  oaci  Iteration  of  the  sl’nplex  algorithm  a  new 
tasic  solution  is  formed  in  whio!:  one  of  tne  basic  variables  x. 


r 


is  replaced  ty  a  non— i  asic  v-.:  lebi  .•  ,■  and  ont?  of  'oiu.r.ns  ?,  of 

•’r 

the  Y5  ^3  r'-:; p naced  by  P  , 

v.e  snail  assume  that  one  stai-ts  out  wits,  a  iasic  solution  to 
the  orlgiriai  system  wi.icm  does  t  violate  condltlu.ns  (I-?).  It  is 
possible  of  CvvUrso  t..at  su'ti  a  oniution  may  not  exist  or  ray  ce 
difficult  tc  determine.  However,  If  wo  begin  with  phase  1  of  tre 
simplex  process  where  tb.e  proble.m.  is  to  detertiine  a  basic  feasible 
solution,  we  will  be  in  the  position  of  having  a  basic  feasitle 
solution  to  a  related  problem  whic,*".  satisfies  the  i-elations  Xj  <  • 

The  reg’nlar  simplex  rules  for  shifting  from  one  basic  solUuion 
of  the  original  system  (1-3^  to  the  ;.ext  apply  unless  the  value  of  a 
variable  In  the  basic  set  changes  from  Xj  to  a  new  value 


short  cut  computing  routine  and  was  first  reported  by  Clifford  Shaw 
and  the  author  before  tr.e  Joint  RAIJD-U. C .  L,  A ,  Seminar  on  Industrial 
Scheduling  In  the  winter  of  19^2. 

2.  For  other  applications  of  tiie  metliod  described  above  see 
A.  Charnes  and  C,  Lemke  [^l]  . 

9.  Quite  often  in  linear  programming  problems  it  is  possible  to 
obtain  a  starting  basis  for  an  enlarged  system  from  a  basis  of  a 
smaller  system.  A  typical  case  occurs  when  a  feasible  basis  for  the 
enlarged  system  exists  which  differs  from  a  feasible  basis  for  the 
original  system  by  having  additional  rows  and  corresponding  unit 
vector  columns.  An  example  of  this  technique  for  bounded  variables 
is  found  in  Charnes  [23  . 


Then  it  is  necessary  to  reduce  the 


>  “j  ®  >  “s- 

permissible  range  of  O  so  that  x,  +  6y  <  and  x  <  in  ot’dcr 

to  preserve  feasibility  in  system  Let  O  «=  6  be  the  largest 

value  for  whicli  all  relations  0  <  S  satisfied  and  suppose 

for  this  critical  value,  O  ,  one  of  the  variables  x,  in  the  basic 

set  X.  ,  X.  ,  ....  X,  (or  the  variable  x„  being  introduced  into 

h  ^2  4 

the  basic  set)  attains  its  upper  bound  . 

Consider  now  a  new  (equivalent)  linear  progra.-nmlng  problem, 
obtaliied  from  the  original  problem  by  replacing  by  ~ 

Letting  deiiote  the  colum-n  of  coefficients  associated  with  Xj  , 
the  effect  is  to  replace 

(a)  The  constant  vector  Q  by  b  — 

(b)  Tlie  vector  P^  by  — P^ 

(c)  The  variable  x,  by  x' 

c*  w 

(d)  Column  P^  in  the  basis  is  replaced  by  unless 

t  =  s;  in  which  case  basis  vectui’S  are  unchanged. 

(e)  The  values  of  the  new  basic  variables  denoted  by 

xj  are 


(1-5) 


(j^  +  t) 

(s  +  t) 


where  0*0  is  the  critical  value  of  O.  The  basic  solution  of  the 
o 

equivalent  programming  problem  has  improved  value  for  th.e  minimizing 
form  (excluding  the  possibility  of  degeneracy). 

We  are  now  in  a  position  to  iterate  using  the  regular  simplex 
algorithm  or  the  modified  one  as  appropriate.  It  may  be  of  passing 


intercGt  to  liote  th.at  the  row  vector  ,6  ("prlcirii^  vector")  used  to 


detertiiine  which  vector  to  introduce  into  a  oasis  B  in  subsequent 
iterations  is  uneffocted  Wi. ether  one  (or  several  colurms)  of  the 
columns  P,  the  basis  ar'e  r'enlaced  by  -P  .  since  B  is  defined  so 


J 


i 


P  I  j  =  Ll »  0,  .  . .  ,  Oj  .  Tl  e  vector 


that  PD  =  P ,  ,  P ,  ,  •  • 

^  J 1  J  O 

to  be  inti'cduced  into  trie  basis  is  deteritiried  ty  Min  BPj  <  0  or  if 

has  been  replaced  by  x'  and  Pj  is  .not  in  the  basis,  by  Min  B{— Pj)<  0 

which  says  a  varlahlc  x,  a*  Its  u;per  bound  may  be  decreased  froni 

i‘3  urper  bound  with,  imt.rovement  in  the  value  of  l..e  solutio.n  r-ro— 

vidiri.^  Ire  negative  of  tb.e  usual  simr^lex  criterion  is  satisfied. 

There  is  a  close  relation  between  the  simplex  al^;orlthm  for* 

the  oriAbln.il  problem  (as  modified  above  for  variables  witli  upper 

sounds)  and  zne  one  which  v/ould  te  obtained  if  one  were  to  directly 

apply  the  I’cguiar  simplex  procedure  to  the  enlarged  problem.  The 

procedure  just  described  was  first  obtained  by  .’-.oting  that  wiien 

th.e  simplex  procedure  is  applied  to  the  enlarged  problem  certain 

computational  simplifications  could  be  obtalr.ed  because  trie  vector 

associated  with  x'  is  a  unit  vector. 

J 


II  -  Block  Triangularity  (General  Case) 


* 

By  "block"  triangular  is  meant  t.nat  if  one  partitions  the 
matrix  of  coefficients  of  the  technology  matrix  into  submatrices, 
the  submatrices  (or  blocks)  considered  as  elements  form  a  triangular 


A  term  suggested  by  Walter  Jacobs. 


Now  the  main  obstacle  toward  the  full  application  of  standard 
linear  programming  techniques  to  dynamic  systems  is  the  magnitude 
of  tiie  matrix  for  even  the  simplest  situations.  For  example,  a 
trivial  13— activity — ^7— item  static  model,  v/hen  set  up  as  a  12--period 
dynamic  m.odel,  would  become  a  l30~activity  by  8^h-ltem  system,  which 
is  considered  a  large  problem  for  application  of  the  standard  simplex 
method.  A  fancy  model  involving,  say,  200  activities  and  100  items 
for  a  static  case  would  become  a  2000  >:  1000  matrix  if  recast  as  a 
10— period  model.  It  is  clear  that  dyna.mlc  models  must  be  treated 

with  special  tools  if  any  progress  is  to  be  made  toward  solutions  of 
these  syste.ms. 

Prom  a  computational  poi.nt  of  view,  there  are  a  numoer  of 
observed  characteristics  of  i..e  dynamic  models  which  are  often  timie 
for  static  models  as  well.  These  are: 

(1)  Tl’.e  matrix  (or  its  transpose )  can  be  arranged  in 

triangula:  form  CEI-2). 

(2)  Most  submatrices  A,  ,  are  either  zero  .matrices  or  rorv- 

J 

vcsec  of  cioments,  most  of  wr.ich  are  zero. 

(f)  H  basis  for  tne  Ei.mplex  mcfr.od  is  of  ben  block  triangular 
with  its  aiagonal  sub:.'.atri ces  square  and  non— singular* 
(referred  to  as  a  "square  olcck  triangular"  basis). 

(4)  P'or  dynacTilc  models  si.milar  type  activities  ar’e  likely 
to  persist  in  the  basis  for  several  periods. 

To  illustrate,  consider  a  dynamic  version  of  the  Leontlef  model 
in  which  (a)  alternative  activities  are  permitted;  (a  simple  case 
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3I£te£i,  (?),  For  example,  von  Nexmann ,  [9],  in  considering  a 
constantly  expanding  economy,  develooes  a  linear  dynamic  nsodel  whose 
matrix  of  coeff icienls  may  be  written  In  the  form  (ll-l) 


( II-l ) 


'  A  A  ' 

(II-2)  '  22  I 


^tpi  ^^2  ^TT  -d 


xvhere  A  is  the  suLmatrlx  of  coefficients  of  activities  Initiated  in 
period  t,  and  B  is  the  submatrix  of  output  coefficients  of  these 
activities  In  the  following  period.  V9ien  activities  extend  over 
many  tine  periods,  it  is  not  difficult  to  show  that  they  can  be 
suDdlvJded  Into  a  sot  of  In  erloc/ed  subactivl ties  over  time,  whose 
input  occurs  at  time  t  and  output  at  tl.me  t+1.  Moreover,  it  is  not 
necessary  that  the  input  output  blocKS  A,E  be  identical  from  one  time 
period  r,c  tne  next.  Because  of  the  general  applicability  of  such 
ct  model,  the  autiicr  in  an  earlier  paper  suggests  that  it  is  worth¬ 
while  to  give  special  attention  to  t!ie  solution  of  linear  programming 
problems  whore  the  matrices  are  of  this  form,  [la].  In  this  paper, 
however,  we  shall  consider  the  partitioned  form  {IEd^)aa  standard; 
primarily  because,  cast  in  thils  form,  most  models  will  involve  fewer 
equations  and  variables  and  because  the  essential  feature  of  block 
triangularity  is  preserved. 


time 


would  le  where  steel  can  be  obtained  from  direct  production  or 
storage),  (b)  inputs  to  an  activity  I'or  production  in  the  t^*^ 
period  nxay  occur  in  same  or  earlier  time  periods.  It  cari  be  shown 
in  tills  model  that  (a)  a  basic  solution  will  iiave  exactly  m  activities 
in  each  tirae  period  (where  m  •*  number  of  time  dependent  equations), 

(b)  eacii  sliirt  in  basis  will  bring  In  a  substitute  activity  in  the 
same  time  period,  and  (o)  optimization  can  be  carried  out  as  a 
sequence  of  one—porlod  optimization  problems;  l.e.,  the  optimum 
choice  of  activities  (but  not  their  amounts)  can  be  dewcrmlned  for 
tiie  first  time  period  (independent  of  th.e  later  periods);  this 
permits  a  d  e  ve:-rr.lnation  for  tne  second  line  period  (independent  of 


the  later  jorlcds). 


etc . 


'.fnen  flow  .-.cdels  are  renlac'-d  with  i.ioi’c  cor.piex  riodels  which 
include  initial  ii.ventories ,  catacitlcs,  ami  '  he  building  of  new 
caiiacitios,  tn  ideal  structure  jf  a  basis  (see  '.iilrd  character¬ 
istic  a’rove )  riO  lor.ge.  t.olds.  However,  tecs  (cari’led  on  since 
19t0)  o.n  -i  riUr.Ler  of  cases  iniicate  that  bases,  while  of'en  not 
square  -'a.n  .u-a'-  in  t..c  seniSe  above,  could  be  rade  so  by 

changing  reiamveijr  few  coliuans  in  U.e  basis  (e.g.,  one  or  two 
activities  in  small  models).  Tiiia  ciiaracterlstlc  of  near  square 
u^Gck  triangula.-ity  of  tiic  basis,  i.c.,  with  nun— singular  square 
subruttrises  dowsi  the  aicigoriai  is,  of  coui’se ,  cornputatiorially  con¬ 
venient  and  this  paper  will  be  ct.ncerned  with  ways  to  exploit  It. 

However*,  there  appears  to  oe  a  strong  altenative  possibility 
which  my  be  built  around  bases  whose  non— zero  elements 
either  cluster*  above  (oi’  belo*w)  the  main  diagonal.  An  example  of 
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this  approach  Is  found  In  the  Production  Smoothing  Problem  proposed 
by  Jacobs  [6]  .  Selrr.er  Joimson  and  the  author  have  been  able  to 
show  that  the  basis  in  that  problem  either  does  not  extend  beyond 
the  main  diagonal  or  if  it  does,  it  does  so  by  not  more  tfian  one 
column.  This  will  be  the  subject  of  another  paper.  Tricse  consider¬ 
ations  point  up  the  need  for  further  I'^esearcii  on  the  str-ucture  of  a 
basis  whose  colunuis  are  drawn  from  a  block  triangular  matrix. 

ThiC  remainder  of  th.is  section  will  be  concerned  witn  a  'technique 
that  should  reduce  materially  the  size  of  the  computation  job  v/hen 
the  given  model  satisfies  the  first  three  empirical  properties. 
Extensions  can  be  introduced  to  take  advantage  of  property  (4)  also 
but  these  are  beyond  Ib.e  scope  of  the  present  paper. 

Let  system  (II— 2)  be  the  form  of  the  matrix  of  coefficients. 

Let  be  a  matrix  v.ltl  colurr.s  and  rov.ts  (‘*^0,1,...,?).  Columjs 
vectors  Pj  which  lave  elem.ents  in  common  with  as  well  as 

their  corresponding  variables,  will  be  considered  as  "belonging  to" 
the  t^‘'‘  perloa.  Similarly,  the  m^  equations  wliich  iiave  coefficients 
in  common  witf.  A.  ^  are  also  consido'ed  as  t'Clonging  to  the  t 
period . 

We  wish  to  apply  the  simplex  algorithm  and  will  do  so  for  each 
iteration  through  the  use  of  an  artificial  basis  m  and  a  true  basis 


Recently  H,  fiarkowltz  of  HAND  has  pointed  out  that  inverses  for 
bases  composed  largely  of  zero  elements  (randomly  distributed  or’  in 
blocks)  may  be  avoided.  Instead,  he  conjectures  that  the  direct 
solution  of  the  associated  system  of  equations  for  each  iteration  (as 
is  done  in  the  transportation  model,  [icj  )  can  be  done  at  a  fraction 
of  the  usual  computational  effort  for  a  general  system  of  this  size. 
He  is  currently  developing  an  electronic  computer  code  to  test  this 
method  out  on  large  systems. 
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3.  j.he  ai’tlllcial  basis  will  be  snuaj'e  block  triangular.  As  many 

columr.s  as  possible  of  B  will  be  made  tiie  same  as  B.* 

It  is  assumed  that  expressions  are  known  which  express  any 

column  of  15  as  a  linear  combination  of  the  columns  P  of  D. 

*^1 


so  that  v/e  may  write 


(Il-ii)  B  =  B.t] 


where  r|  is  a  matrix  whose  colamn  has  coef f icients  If  F 

has  r:Uiny  columns  in  common  with  B,  it  is  clear  that  p  will  be  com¬ 
posed  largely  of  unit  vectors  so  that  tne  essential  part  of  rj 
consists  of  those  columns  whlcl;  give  the  representations  in  ter-rr.s 

of  F,  of  those  vectors  ?  in  E  and  not  in  (called  artificial 
“i  ^i 


♦ 

The  u.se  of  true  and  artificial  bases  has  many  important  appll— 
catior.;j .  Some  of  these  will  be  considered  in  subseque.nt  papers. 

In  general,  the  purpose  of  the  artificial  basis  is  to  have  a  basis 
in  a  desirable  form  for  computa*  lo.ns ;  the  purpose  of  the  side  con— 
dltlon  is  to  transform  the  computations  based  .on  an  artificial  basis 
£o  tb.eir  correct  value  in  terns  of  the  troie  basis.  Apolicatlon  of 
such  a  device  calls  for  some  Judgment,  since  it  is  clear  that  if  the 
.nuirfuer  of  side  conditions  becomes  too  large,  the  method  will  have  no 
advantages  over  a  standard  solution  . 

For  our  purposes  it  is  not  strictly  necessary  that  these  arti¬ 
ficial  vectors  be  part  of  the  original  set  of  vectors  P.;  they  could 
(if  convenient)  be  any  vectors  (such  as  the  artificial  unit  vectors 
found  in  the  regular  simplex  process). 
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vectors)  In  terms  of  P,  . 

J 

In  the  standard  application  of  ti»e  revised  simplex  algor i Hut. 
fiij  ,  it  is  cuGto.mary  to  rrial.ntain  the*  inverse  of  tlie  basis  (or  the 
inverse  In  product  form  )  in  order  to  solve  readily  the  system  of 
euua  t  iorsd 

(II-3)  'ih  =  [1,  0,  0] 


3Y  - 


v/here  3  is 
vector  ente 
ceding  basi 


the  price  vector*  and  Y  Is  tiie  representation 
rlrio  the  next  basis  in  terms  of  tr.e  vectors  o 
s.  Ti.ls  v;e  replace  by 


of  tne 
f  tlie  pre- 


(II-7)  pd  *  [1,  0,  .  .  .  ,  0]n 


(II--.)  %  *  :  Y  «  tj*Y 

it 


In  order  to  solve  readily  systems  liivolvlng  r?  as  matr’lx,  it  Is  only 
necessary  to  .naintain  th.e  Inverses  of  tr.e  smaller  non— singular 


*T!  is  definltlc.n  of  p  applies  only  to  phase  II  of  the  clnplox 
procedure;  for  phase  I,  replace  tie  rlght-4iand  alcie  by  L®» I »0»  •  •  •  »QJ  » 
see  L'-a]  .  where  It  is  anauned  that  the  first  column  of  the  taslo  la 
P  corresDOndlng  to  the  variable  In  ^  phase  I,  however, 

the  second  coluriin  correspoiicis  to  dumiriy  variable  whose  value 

is  being  maximized. 
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dlagonal  raaurlces  of  B  (or  Uieir  invet'ses  in  product  form)  which 
we  denote  by  examule,  in  solving  (11—8)  the 

inverse  of  w.hen  multiplied  by  the  first  rn^  components  of  the 

right-.iand  row  vector  Wj’ll  give  the  first  components  of  Y. 

Because  of  triangularity,  these  values  can  be  substituted  into 
equations  associated  with  the  second  time  period  and  the  next 
coinponen ts  of  Y  obtained  thr'ough  application  of  the  inverse  of 

Except  for  elements  associated  wltli  the  Inverses  of  the  diagonal 
blocks  (either  in  direct  or  product  form),  it  will  be  noted  that 
all  other  operacions  Involve  scalar  products  with  parts  of  colurons 
of  B  in  their  original  formi.  These  often  are  entirely  null  or 
composed  lar*gely  of  zero  elements.  This  advantage  Is  to  be  con¬ 
trasted  with  t.bo  case  where  the  entire  artificial  basis  (or  13“^) 

is  rnalnialnod! 

Each  change  ir  true  basis  roolaces  a  vector  P.  by  P  .  The 

s 

representation  of  P,  l.n  terias  of  the  vectors  of  the  next  basis  is 

'‘r 

given  by 


(II-O) 


I 

i4'r 


4 


where  rj.  Is  glveii  in  ter-ms  of  the  components  of  y,  of  Y  by 


IJ,,  ' 


(ii-io)  n 


(i  +  r) 
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By  substituting  thie  expression  for  P,  in  (11—3),  vectors  P„  can 

^  , 

i.  4 

oe  recxpressed  in  uern'.s  of  the  next  basis,  Tnis  coristitutes  the 
trutisfornation  of  ij  froiri  one  cycle  to  ncA..  If  r ..  is  in  B  aleo,  then 

in  the  next  cycle  P.  will  be  an  artificial  vector*,  and  expression 
forms  part  of  the  essential  part  of  tj  for  the  next  cycle. 

If  P,  is  .not  in  B,  its  expressiorr  (II— t;)  in  terTts  of  the  true 

U  jp, 

basis  is  no  longer  of  any  interest  and  may  be  thrown  away.  In  tlie 
for-mer  case  tie  size  of  t)  (where  by  "size"  is  meant  the  number  of 
essential  columns)  has  increased.  In  the  latter  it  i.as  remained 
the  sasne .  On  the  other  hand  if  P  was  artificial  in  b  i.n  the  ore— 

3 

\iou3  cycle  and  Inti-oduced  into  B  in  the  next,  then  the  size  of 
r)  would  decrease. 

We  next  consider  the  possibility  of  modifying  tire  definition 
of  B  in  order  to  decrease  the  num.ter  of  essential  colunmo  in  rj. 

This  is  important  because  unless  the  size  of  ^  can  be  kept  relatively 
low,  the  transformations  of  ^  are  the  sa.me  as  the  transfomat Ions  on 
the  colU{!u;s  of  B~^  in  the  standard  simplex  algorithm  and  no  advan¬ 
tage  would  accrue  by  using  this  approach.  Let  P^  be  a  column  of  B, 
not  in  I,  belonging  to  period  t,  and  suppose  there  are  artificial 
vectors  also  belonging  to  this  period.  We  form  the  representation 
of  the  partitioned  part  of  P^  belonging  to  period  t  in  terms  of  the 
columns  of 


(Il-ll) 


where  those  components  of  a  vector  associatod  with  pex’lod  t  ar-e 

denoted  by  a  superscript  (t).  Consider  now  those  components  of 

corresponding  to  artificial  column  vectors  P^.  If  any  of 

these  components  are  non— zero ,  then  it  is  cleai*  t!;at  can  replace 

the  corresponding  P^  in  P  and  thus  reduce  the  size  of  the  essential 

part  of  Tj;  moreover,  Y' ''  may  be  used  as  in  regular  simplex  routine 

to  obtain  the  corrected  inverse  of  (in  direct  or  product  form). 

It  will  be  noted  that,  because  of  block  triangularity  of  the 

original  matrix,  the  first  step  In  the  representat Icn  of  in  term 

of  columns  of  B  by  (II— t)  gives  the  representation  of  P^^^  in  teras 

of  the  colamns  of  il.  .  (where  P^  belongs  to  period  t).  However, 

z  c  z 

this  Is  the  relation  required  (ll-ll)  and  may  be  used  to  ueter- 

nine  if  P  can  renlace  an  artificial  vector  in  b-.  iience,  in  this 
s 

case  it  is  not  necessary  to  make  a  senarate  calculation  to  deter¬ 
mine  whetlier  can  replace  in  B.  Moreover-,  by  saving  the 


relations 


that  express  P^^^  in  tomns  of  the  columns  of  11  (and 


transforming  them,  should  the  columns  of  change)  it  Is  possible 
to  have  all  relations  (II-ll)  readily  available.  There  are,  of 
course,  as  many  suen  r-elatlons  as  there  are  essential  columns  in 
q;  however,  the  wo.  involved  in  maintaining  these  relations  is  a 
fraction  of  that  r-eoulred  for  rj. 


Ill  —  Secondary  Constraints 


Here,  as  In  the  special  case  of  variables  with  upper  bounds, 
we  suppose  in  addition  to  (I— 1)  the  variables  must  satisfy  a 
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"secondary'"  system  of  constraints  of  the  form 


(III-I) 


+  X 


n+k 


(k 


.  ,m 


i , 


mathematically,  • hese  latter  restrictions  differ  in  no  vay  from 
ti;e  forr.ier,  but  from  the  physical  point  of  view  it  is  anticipated 
that  only  a  small  subset  of  the  restrictions  (III— 1)  will  be 
active  in  an  optimal  solution.  By  a  constraint  being  "active"  is 
meant  that  its  "slack"  variables  =  0. 

To  illustrate:  In  a  gasoline  blending  i  robleni  there  may  be 
a  number  of  equations  controlling  the  performance  characteristics 

of  a  blend,  fer  example.  it.s  viscosity,  specific  gravity,  . 

It  is  expected  that  only  one  or  two  of  these  characteristics  are 
limiting  in  a  given  r-un.  A  second  related  example  would  be  capacity 
restraints  on  various  processes  within  the  refinery  as  in  a  thermal 
cracking  unit,  storage  capacity  of  tanks,  etc.  Again  it  may  be 
expected  that  so.me  of  these  restraints  will  be  active,  but  not  many 
for  any  particular  problem  on  any  particular  Iteration  of  the 
simplex  process. 

To  take  advantage  of  the  expected  small  number  of  active 
secondary  constraints,  we  shall  make  use  (as  in  section  II)  of 
^  true  basis  and  of  an  artificial  square  block  triangular  basis 
in  executing  the  simplex  algorithm. 

For  this  problem  the  artificial  basis  will  have  a  special 

form;  its  columns  will  consist  of  vectors  P  ,  Pq  ,  ,  . . . ,  P_  ; 

°  ^1  P2  Pm 


-17- 


^n4-l’  *n+2’  -■  <  vectors 

are  o^^viously  unit  vectors.  B  nay  bo  partitioned  in  the  fonn 


e(i) 


(III-2)  B 


where  are  the  components  associated  with  system  (l-i), 

B  ^  with  system  (lll-l),  and  an  rn'  x  m'  Identity  matrix. 

Since  (III— 2)  is  in  "square  block"  triangular  form,  it  is  clear 
it  is  only  necessary  to  icnow  the  Inverse  of  the  smaller 
m  X  m  subnatrlx  (or  its  equivalent )  to  determine  Y  or  |3 

through  T). 

Let  the  true  basis  consist  of  the  vectors  P  P  p 

o  Jl'  "  ■  '  J  ^ 

It  will  be  supposed  that  many  of  t.he  vectox’S  of  the  ax-tiflclal 
basis  are  the  same  as  those  in  the  true.  However,  some  of  the 
unit  vectors  in  tne  artificial  basis  .may  not  be  fou.nd  i.n  the  true 
basis.  In  this  case,  the  side  conditions  (ll-;^)  are  simpl;/  the 
representations  ol  these  artificial  unit  vectors  in  terras  of  the 
vectors  of  the  true  basis.  With  these  observations  one  raay  now 
proceed  to  apply  the  algorithm  of  section  II  to  the  special  case 
of  secondary  constraints. 

The  method  of  additional  restraints  has  been  found  to  be  a 
powerful  tool  in  solving  many  large  scale  systems,  for  example, 
the  recent  successful  solution  of  a  49-city  traveling  salesman 
problem.  Indeed,  in  some  problems  it  is  easier  to  find  a  point 
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p  where  a  Tunctlon  assumes  a  mlnimuni  for  a  region  R*  than  for  a 
smaller  required  region  R  in  R*.  If,  by  good  luck,  the  minimum 
value  of  ihe  function  is  assumed  at  a  point  p  of  R*  which  is  also 


a  point 


tj>en  it  is  obvious  that  this  point  is  also  thie  r‘6* 


culrcd  optimum  solution  for  P. 


To  illustrate,  suppose  an  optimum  solution  is  obtained  for 
(I— 1)  witiiout  regard  to  whether  the  slack  variables  x  ..  defined 
by  the  secondary  constraint  conditions  (III— 1)  are  non— negative  or 
not.  If  by  luck  all  >  0  then  the  solution  Is  an  optimal 

solution  for  (I— l)  and  (III— l)  combined.  Consider  now  a  situation 


where  only  a  few  of  the  seco.ndary  restraints  are  expected  to  be 
active;  i.e.,  the  solution  may  bo  expected  to  have  some  but  only 
a  few  negative  values.  In  this  case  it  appears  reasonable  to  take 
the  ontimum.  solution  of  (I-l)  as  a  good  starting  point  to  begin  a 


corrective  procedure  to  clean  up  the  negative  values  of  the  variables 
in  order  to  ootai.n  an  optimum  solution  for  (I— l)  and  (III— l) 


combined.  This  approach  can  be  fomiallzed  as  follcv;s: 

(a)  Find  an  ootirnum  basic  solution  (x  ,x,  ,x.  ,...,x,  ) 

°  h  ^2  *  ’^m 

to  the  smaller  system  ( I— 1 )  wlthiout  regard  to  (III— l). 
(The  fact  that  a  smaller  system  Is  being  first  solved 


can  be  an  important  computational  advantage  in  practice 
over  methods  which  work  always  with  the  entire  system.) 

(b)  Determine  the  values  of  the  slack  variables  by  substitution 
in  (III-l)  and  regard  B  *  Pj^ , . .  , ,  >  •  •  •  > 

as  a  starting  basis  for  the  combined  system  (I— l)  and  (III— l). 
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^"+1  -  °  solution  associated  v<lth  this  basis, 

men  this  Is  an  optimal  solution  for  combined  system 
and  this  tennlnates  the  algorithm.  If  not.  It  Is  clear 
that  the  "price  vector"  p  for  this  basis  satisfies 
pPj  >  0  for  J-1,2, . . . ,n,n+l , . . . ,n+m' .  Indeed,  p  has 
Clearly  zero  components  for  those  components  correspond¬ 
ing  to  equations  of  system  (HI-i)  «hlle  those 
corresponding  to  system  (I-l)  are  the  same  as  the 
optimal  3  for  the  smaller  system, 

lliis  basis  can  be  used  to  initiate  the  dual  simplex 
of  Lemke,  as  this  method  requires  that  all 
>0.-  See  [7j,  [ob]  .  Computationally,  the  latter 
procedure  resembles  Uie  simplex  algorithm  in  that  it 
Shifts  from  one  basis  to  the  next  and  differs  only  in 
the  selection  criteria  for  determining  the  column  to 
drop  and  to  introduce  into  the  next  basis.  It  does  not 

-equi.e  that  remain  non-negative  from  one  iteration 
to  the  next . 

The  initial  basis  B  is  block  triangular;  however, 
subsequent  basis  will  have  to  lose  this  characteristic. 
However  by  introducing  an  artificial  basis  as  given  In 
(111-2)  and  side  conditions  to  express  the  artificial 
unit  vectors  in  terms  of  the  vectors  of  the  true  basis, 
the  computational  advantages  discussed  in  section  II  of 
the  near  block  triangularity  of  B  can  also  be  realized. 


i 
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Finally,  it  should  be  remarked  that  if  it  is  known  in  advance 
that  a  certain  variable  x  in  a  general  linear  programming  must  be 
a  basic  variable  in  the  optimum  solution,  this  variable  can  be 
eliminated  from  all  but  one  of  the  oauailons  and  the  objective 
function.  The  resulting  smaller  system  can  then  be  optimized  and 
the  values  of  this  solution  substituted  in  the  rerralning  equation 
(v/hich  is  treated  like  a  secondary  constrai.nt  equation)  to  deter¬ 
mine  the  value  x.  To  Illustrate  in  a  dynamic  economic  model  it 
is  h.lghly  likely  that  the  stock  production  activities  v/ill  be 

♦ 

operating  in  all  time  periods.  In  a  recent  example  H.  M,  Wagner 
has  shown  that  it  is  convenient  to  eliminate  the  corresponding 
variables  from  all  but  one  equation  eacli  and  optimize  the  remain¬ 
ing  system.  In  a  few  examples  tested  by  this  app;x>ach  it  turned 
out  to  be  a  trivial  matter  to  make  proper  adjustments  to  correct 
the  negative  stock  production  activities  everi  without  recourse  to 
the  dual  simplex  algorithm  recommended  earlier. 


* 

Unpublished. 
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